ON HANKEL-TYPE OPERATORS WITH DISCONTINUOUS 
SYMBOLS IN HIGHER DIMENSIONS 



A.V. SOBOLEV 

Abstract. We obtain an asymptotic formula for the counting function of the discrete 
spectrum for Hankel-type pseudo-differential operators with discontinuous symbols. 



1. Introduction 
Consider on L 2 (a, 6), < a < b < oo the integral operator of the form 

(1) (r atb (k)u)(x) = / k(x + y)u(y)dy, 



with some function k = k(t),t > 0. The operator T 0oo (k) is called Hankel operator on 
L 2 (0,oo), see [9], p. 46. For T ab (k) with 0<a<f><oowe use the term truncated 
Hankel operator. The symbol x = x(£),£ G K, of the operator T 0tOO (k) is defined (non- 
uniquely) as a function such that its Fourier transform k(t) coincides with k(t) for all 
t > 0. We are interested in the case, when the symbol is a bounded function 

with jump discontinuities, which ensures that the operator To i00 (k) is not compact. The 
leading example of such an operator is given by the Carleman kernel k(t) = > 

(see [9], p. 54), for which one can choose 



(0 



-7TZ,e<0, 
7TZ, £ > 0. 



The operator Ta^k) with this symbol is bounded for all a and b, < a < b < oo, and 
||r a)00 (A;)|| = 7r, a > 0. If a = and/or b = oo, then r a f) (fc) is not compact. Among other 
results, H.S. Wilf investigated the asymptotics of the counting function of the discrete 
spectrum of the truncated operator r lib (/c), k{t) = f 1 , as b — > oo (see [14], Corollary 1). 
He proved that the number of eigenvalues of Ti y b{k) in the interval (A, oo) for any A G 
(0, 7r) is asymptotically equal to C(A) log b as b — > oo, with some explicit constant C(A). 
H. Widom in [12], Theorem 4.3 derived a similar asymptotic formula for the truncated 
Hilbert matrix (i.e. matrix with the entries (j + k+ l) -1 , j, k = 0, 1, 2, . . . ), as well as 
for some more general Hankel matrices. Later, a good deal of attention became focused 
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on the asymptotics of the determinants of truncated Hankel (and Toeplitz) matrices, see 
e.g. [1], [2], [3] and [6]. 

The Hankel operator T oo (k) can be rewritten in the form 

(T 0>oo (k)u)(x) = (G(k)u)(-x), x>0, 

where 

/oo 
k(v - x )X(o,oo)(y)u(y)dy. 
-oo 

Here X(o,oo) denotes the characteristic function of the half-axis (0, oo). As A. Pushnitski 
and D. Yafaev [10] indicated to the author, in the scattering theory context it is natural 
to consider alongside r 0iOO (A;) the symmetrised Hankel operator 

(2) H(k) = G(k) + G*(k). 

In this note we study a multi-dimensional analog of the truncated symmetrised Hankel 
operator with a discontinuous symbol. It is defined in the following way. Let Op^(a) and 
Op^(a) be the standard "left" and "right" pseudo-differential operators with the smooth 
symbol a = a(x, £), x, £ e M d , d>\, i.e. 

(OpLa)u(x) ={£) J J e^ (x - y *a(x,£My)^y, 

(Op>Mx)=Q^) J j e ia ^a(y,Z)u(y)dtdy, 

for any function u from the Schwartz class on M. d . If the symbol a depends only on £, 
then the above operators coincide with each other and we simply write Op Q (a). Here 
and below integrals without indication of the domain are assumed to be taken over the 
entire Euclidean space M. d . The large constant a > 1 can be thought of as a truncation 
parameter. The conditions imposed on the symbol a in the main Theorem 1 below ensure 
that the above operators are trace class for all a > 1. 

In order to introduce the jump discontinuities, let A, Q be two domains in M. d , and let 
Xa(x), xn(£) be their characteristic functions. We use the notation 

Pn, a = OPaixn)- 

Define the operator 

T a (a) = T a (a; A, tt) = x\Pn,a Op l a (a)P n<a XA, 
and its off- diagonal version 

G a (a) = G a (a; A, Q) = (1 - xa)^ Op l a (a)P n , a XA- 
The central object for us is the following Hankel-type self-adjoint operator 
H a (a) = H a (a; A, SI) = G a (a; A, ft) + G* (a; A, ft), 



ON THE HANKEL-TYPE OPERATORS 3 

which is a natural multi-dimensional analogue of the truncated symmetrised operator 

(2) . Note the following elementary property of H a (a). Let U be the unitary operator in 
L 2 (R d ) defined by 

Uu = u X a - u(l - X a),u e L 2 (R d ), 

so that U* = U. Then U*H a (a)U = —H a (a). This implies, in particular, that the 
spectrum of H a (a) is symmetric w.r.t. zero, i.e. 

(3) dimker (H a (a) - A) = dimker (H a (a) + A), A e R. 

Let g be a function analytic in a disk of a sufficiently large radius, such that g(0) = 0. 
In 1982 H. Widom in [13] conjectured an asymptotic formula for the trace tvg(T a ), 
a — > oo, which was subsequently proved in [11]. In order to state this result define for 
any symbol b = 6(x, £), any domains A, and any (^-surfaces S, P, the coefficients 

(4) 2H (&) = 2H (5; A, Q) = jT 6(x, 

(5) jar 1 (6) = an 1 (6; 5 ,P) = 7 -i TT / / 6(x,0|n 5 (x) .n P (0|^^x, 

where ns(x) and np(^) denote the exterior unit normals to S and P at the points x and 
£ respectively. Define also 

Then, as conjectured in [13] and proved in [11], 

(7) tr#(T Q (a)) = a d W (g(a); A, fi) +a d " 1 loga 2»i a); 9A, dti) + o^ 1 log a), 

The aim of this note is to establish a similar trace formula for the operator H a (a), see 
Theorem 1. 

We use the standard notation ©i for the trace class operators, and ©2 for the Hilbert- 
Schmidt operators, see e.g. [4]. The underlying Hilbert space is assumed to be L 2 (IR rf ). 
By C, c (with or without indices) we denote various positive constants independent of a, 
whose precise value is of no importance. 

Acknowledgment. The author is grateful to G. Rozenblum for discussions, and to 
A. Bottcher and A. Pushnitski for stimulating remarks. This work was supported in part 
by EPSRC grant EP/F029721/1. 

2. Main result 

2.1. Definitions and main results. To state the result define for any function g = 
g(t),t E R, such that \g(t)\ < Ct, the integral 

(8 » "W'^f^' 
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Denote by 

„ m 9(t)+g(-t) 
yev\^) — 2 

the even part of g. Let 22Ji be as defined in (5). The next theorem contains the main 
result of the paper: 

Theorem 1. Let A, f2 C M. d , d > 2 be bounded domains in W 1 such that A is C 1 and il 
is C 3 . Let a = a(x, £) 6e a symbol satisfying the condition 

(9) max sup |V£V?a(x,£)| < oo, 

0<n<d+2 x c 
0<m<d+2 ' s 

and having a compact support in both variables. Let g = g(t),t G R be a function such 
that g cv {t)t~ 2 is continuous on R. T/ien 

(10) trp(ff Q (a)) = a"" 1 log a 2Hi (11(^5 |a|);9A,afi) + o^" 1 log a), 
as a — )> oo. 

Note that the coefficient on the right-hand side of (10) is well-defined for any function 
g satisfying the conditions of Theorem 1. Note also that in view of (3), we have 

(11) trg(H a )=trg ev (H a ). 

Remark 2. Denote by n±(X;a) with A > the number of eigenvalues of the operator 
±iJ Q (a) which are greater than A. In other words, 

n±(Ai;a) =tr X i(±H a (a)), I = {X,\\H a {a)\\ + 1). 

Since the interval I does not contain the point 0, this quantity is finite. Due to (11), 
n + (X;a) = n_(A;a). In order to find the leading term of the asymptotics of n±(\;a), 
a — > oo, approximate the characteristic function xi from above and from below by 
smooth functions g. Then it follows from Theorem 1 that 

(12) n±(A;a) = ^'Hoga W^xr, \a\)) + o(a d ~ l log a). 
A straightforward calculation shows that 

H(x/;|a(x,^)|) = I vr 2 2A 
[0, |a(x,OI <2A. 

The formula (12) can be viewed as a multi-dimensional analogue of the asymptotics 
derived for the Carleman kernel in [14], Corollary 1. 

Theorem 1 will be derived from the following theorem, which is simply formula (10) 
for even polynomial functions g: 
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Theorem 3. Let the domains A,Q C M. d , d > 2 and t/ie symbol a = a(x, £) 6e as m 
Theorem 1. Then for g p (t) = t p ,p = 1,2, ... , 

(13) tr 52p (iy Q (a)) = a"" 1 log a 2Bi(it(<? 2p ; |a|);9A,9fi) + o^loga), 
as a — > oo. 

Once this theorem is proved, the asymptotics is extended to functions g satisfying the 
conditions of Theorem 1 with the help of an elementary trace estimate for g(H a ). 

3. Auxiliary estimates 

The proof relies on various trace class estimates, some of which were obtained in [11]. 
In these estimates we always assume that the symbols a and b satisfy the condition (9) 
and that the domains A, Q are as in Theorem 1. 

We begin with well known estimates for operators with smooth symbols: 

Proposition 4. Let d>l and a > c. Suppose that the symbols a,b satisfy (9). Then 

||OpL(a)|| + ||Op»||<C. 

If, in addition, a and b are compactly supported in both variables, then 

HOp^-OpMHe^C^- 1 , 

\\Op l a (a) 0pL(b)-0pL(ab)|| 6l <Ca d -\ 

The above boundedness is a classical fact, and it can be found, e.g. in [5], Theorem 
B[, where it was established under smoothness assumptions weaker than (9). For the 
trace class estimates see e.g. [11], Lemma 3.12, Corollary 3.13. 

The following estimates are for operators with discontinuous symbols. 

Proposition 5. Suppose that the symbol a satisfies (9) and has a compact support in 
both variables. Assume that a > c. Let Op a (a) denote any of the operators Op l a (a) or 
()!>;>). Then 

||[Op a (a),Pn I «]|k + ll[Op»,XA]|| ei < Ca d -\ 
See [11], Lemmas 4.3 and 4.5. 

The next proposition is a crucial ingredient in our proof: Theorem 3 is derived from 
the following local version of the asymptotics (7). 

Proposition 6. Suppose that the symbols a and b satisfy (9), and that b has a compact 
supports in both variables. Then for g p (t) = t p ,p = 1,2, ... , 

tr(Op l a (b)g p (T a (a))) = a d %B (bg p (a); A, Q) 

(14) +a d - 1 \oga 2Ui(62l(0 p ;a);0A,0n) + o(a d " 1 loga), 
as a — > oo. 
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See [11], Theorem 11.1. 

The following Hilbert-Schmidt estimate is important when deriving Theorem 1 from 
Theorem 3. 

Proposition 7. Suppose that the symbol a satisfies (9) and has a compact support in 
both variables. Assume that a > 2. Then 

\\G a (a)\\ 2 &2 <Ca d - l \oga. 
See [11], Lemma 6.1, and also papers [7, 8] by D. Gioev. 

4. Proof of Theorem 1 

4.1. Polynomial functions, reduction to the operator T a . We begin with studying 
the modulus of the operator G a {\), i.e. the operator |G a (l)| = a/ G* a {\)G a {\). 

Lemma 8. Suppose that the symbol b satisfies (9) and has a compact support in both 
variables. Then 

tTO V {b)g p {G* a {l)G a {\)) = ^-Moga 2Ui(6il(^ 2p ; 1); <9A, dQ) + o^ 1 log a), 
as a — > oo. 

Proof. Denote G = G a (l) and T = T Q (1). By inspection, G*G = T-T 2 , so g p (G*G) = 
h(T), with the polynomial h(t) = g p (t — t 2 ). Thus one can use Proposition 6. Note that 
h(l) = 0, so that the first asymptotic coefficient in (14) vanishes, see (4). Let us find 
the second asymptotic coefficient, calculating 1). Using (6) and (8) we get 

nth -n 2 H 9 P {t-t 2 ) u 1 f 1 g p (%) 1 

Thus, by Proposition 6, 

tr(Op l a (b)h(T)) = ^'Hoga 2Ui {biX(g 2p ; 1); OA, dti) + o(a d - 1 log a), 

which leads to the proclaimed formula. □ 

Now we can prove the asymptotics for the operator H a (a): 

Proof of Theorem 3. For any pair of operators B\ , B 2 we write B x ~ B 2 if 

\\Bi - B 2 \\ &1 < Ca d -\a> 1. 

Denote H = H a (a),G = G a (a), and note that g 2p (H) = g p (H 2 ). Since G 2 = 0, (G*) 2 = 
0, it follows that 

H 2 = GG* + G*G. 

This sum is in fact an orthogonal sum of two operators acting on the mutually orthogonal 
subspaces L 2 (CA) and L 2 (A), where CA denotes the complement of A. Moreover, the non- 
zero spectra of G*G and GG* are the same. Thus 

(15) trg 2p (H) = tr g p (H 2 ) = 2tr g p (G*G). 
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Using Propositions 5 and 4, we conclude that 

G~ OpL(a)G a (l)~G a (l)0 P L(a), 
Op l a (a)G* a (l)~G* a (l)Op l a (a), 
G*G~ OpL(|a| 2 )G;(l)G a (l). 

Thus referring again to Proposition 4, we obtain that 

g p (G*G)~OpUH 2p )g P (G:(l)G a (l)). 

Now it follows from Lemma 8 and formula (15) that 

tr g 2p (H) = 2tr(OpL(|a| 2 ^ p (G;(l)G a (l))) + 0{a d ~ l ) 

= a*" 1 log a 2Hi(|a| 2p il(^ 2p ;l);9A,9Q) + o^" 1 log a). 

Since \a\ 2p H(g2 P ; 1) = il(<?2p; this implies the asymptotics (13). The proof of Theorem 
3 is now complete. □ 

4.2. Proof of Theorem 1. By virtue of (11) we may assume that g = g cv . Since 
h(t) = t~ 2 g cv (t) is continuous, for any e > there exists an even polynomial p = p(t) 
and a continuous function r = r(t) such that 

9ev(t) = pit) + t 2 r(t), max \r(t)\ < e. 

te[-||tf a ||,||H a ||] 

In view of (13), 

trp(H a (a)) = a*' 1 log a 2Ui(U(p; a)) + o^" 1 log a). 
Moreover, by the definition (8), 

|2Hi(H(p;a))-2ITi(il( ff ev;a))|<Ce. 
Let us estimate the error term: 

\\ 9cv (H a (a)) - p(H a (a))\\ 6l < \\r(H a (a))\\ \\H 2 a (a)\\ &1 

< 2e||G a (a)||| a < Cea 4 ' 1 log a, 
where we have used Proposition 7. Collecting the above estimates together, we obtain 

limsup — — 1 tr g(H a (a)) - a d ~ x log a 2Ui(il(cfc v ; a))| < Ce. 

a^oo ofl Moga 

Since e > is arbitrary, the asymptotics (10) follows. 
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